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Foreword 


This  Final  Technical  report  is  a  brief  summary  of  the  work  conducted  on  each  of  three  research 
tasks  at  the  Center  for  Multisource  Information  Fusion  (CMIF)  at  the  University  at  Buffalo, 
Buffalo,  New  York'  over  the  period  1996-1999.  Under  co-sponsorship  of  the  Air  Force 
Research  Laboratory’s  (AFRL)  Information  (IF)  and  Sensors  (SN)  Directorates,  CMIF 
conducted  research  on  three  different  topics  in  this  period: 

•  Research  on  Correlation  Science 

•  Learning  in  Distributed  Fusion  Systems  for  Decision-Making 

•  Information-Sharing  in  Distributed  Fusion  Applications 

This  report  is  a  compilation  of  some  of  the  key  points  in  terms  of  purpose  and  motivation,  as 
well  as  results,  associated  with  each  of  these  tasks.  Individual  technical  reports  resulting  from 
each  task  have  been  previously  sent  to  AFRL. 


A  cknowledgement 

CMIF  gratefully  acknowledges  the  support  of  the  Air  Force  Research  Laboratory  for  the  conduct 
of  this  research. 


'  The  “University  at  Buffalo”  is  the  current  name  for  what  has  often  and  heretofore  been  known  as  the  State 
University  of  New  York  at  Buffalo. 
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Research  on  Correlation  Science 


Principal  Investigators;  Dr.  James  Llinas,  Research  Professor,  UB;  Dr.  Chris  Bowman,  Consultant, 

Selcuk  Savas,  Graduate  Student 


The  emphasis  of  this  project  was  selected  to  be  the  function  of  data  fusion  that  has  the  greatest 
impact  on  operational  system  performance.  The  two  key  factors  for  such  a  selection  is  the 
importance  of  the  function  and  its  maturity.  The  least  mature  of  all  the  functions  of  data  fusion 
is  data  association,  which  has  three  sub-functions  (i.e.,  hypothesis  generation,  evaluation,  and 
selection).  Hypothesis  generation  is  a  more  ad  hoc  function  that  reduces  the  size  of  the  rest  o 
the  data  association  problem.  Hypothesis  selection  is  the  most  mature  of  the  three  functions  due 
to  the  extensive  search  algorithm  developments  performed  in  the  field  of  operations  research. 
This  effort  thus  focused  on  the  hypothesis  evaluation  function  of  data  association  since  it  is  the 
least  mature  and  is  the  basis  upon  which  hypothesis  selection  and  the  rest  of  the  fusion  problem 
is  solved.  Within  that  function  emphasis  was  placed  on  the  approach  to  and  nature  of  the 
“scoring  metrics”  used  within  the  hypothesis  evaluation  processing. 

1.0  Definition  of  Scoring  Metrics 


The  performance  of  the  following  five  scoring  metrics  is  evaluated  in  a  selected  set  of  test 
cases: 

1.  chi-square  (CHI)  statistic 

2.  integral  of  the  tail  of  the  chi-square  distribution  (CHI-Tail) 

3.  max  a  posteriori  (MAP) 

4.  probabilistic  data  association  (PDA) 

5.  joint  hypothesis  and  state  optimization  (JHSO) 

This  section  refines  these  five  metrics  for  three  cases  of  1 -dimensional  report-to-track 
problems  as  follows: 

report  with  each  of  two  tracks  having  different  variances 
(e.g.,  a  pop-up  target)  not  associated  with  either  of  two 
tracks  having  different  variances 


1.  case  1:  the  association  of  a  single 
(i.e.,  cases  la  and  lb) 

2.  case  2:  a  report  on  a  new  object 
existing  tracks 

3.  case  3:  2  reports  associated  with  2 
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1.1  Chi-Square(CHI)  Score 

The  CHI  score  (i.e.,  also  known  as  the  Mahalanobis  score)  is  the  exponent  of  the  Gaussian  for 
the  difference  between  the  report,  S,  and  the  track,  T.  Namely, 

CHI  score  =  rv'l  =  (S-T)'  /[R  +  P] 

where  R  is  the  variance  of  S  and  P  is  the  variance  of  T.  The  association  hypothesis  selected  is 
the  one  that  minimizes  this  score.  For  the  multi-report  case,  sum  these  scores  is  minimized.  For 
case  2  a  3-sigma  limit  for  association  is  used,  so  the  chi  score  for  non-association  is  9.0. 

1.2  Integral  Of  The  Tail  Of  The  Chi-Square  Distribution  (CHI-Tail)  Score 

The  integral  of  the  tail  of  the  chi-square  distribution  (CHI-Tail)  is  used  in  statistical 
hypothesis  testing  approaches  for  deterministic  data  association.  To  compute  the  of  integral  of 
tail  of  chi  square,  for  one  dimension  first  compute  the  integral  of  the  N(0,1)  Gaussian  from 
negative  infinity  to  the  square  root  of  the  CHI  score,  x,  (i.e.,  N(Vx))  and  insert  into  the  equation 
below: 

CHI-Tail  =  1  -  int  of  tail  of  chi  (x) 

=  1  -  .8  [V27i]  [N  (Vx)  -  .5  ] 

For  example,  the  integral  of  tail  score  (where  the  current  chi  score  =.455)  is  CHI-Tail  (.455)  =  1 
-  .8  [2.5]  [N(.675)  -  .5]  =  1  -  2  [  .75  -  .5]  =  .5.  Choose  the  association  that  has  the  largest  CHI- 
Tail  score.  For  case  2  the  equivalent  of  a  3-sigma  limit  for  association  is  used,  so  the  inte^al  of 
the  tail  score  for  non-association  is  0.0026.  For  the  single  report  case  1  experiments  herein  the 
association  results  will  be  the  same  as  with  CHI,  since  where  two  CHI  scores  are  equal  two  CHI- 
Tail  scores  will  also  be  equal. 

1.3  Max  A  Posteriori  (MAP)  Score 

There  are  various  max  a  posteriori  (MAP)  scoring  criteria  for  data  association  and  state 
estimation  [4].  The  most  common  of  these  is  the  one  defined  on  top  of  Figure  1.  This  the 
usualMAP  deterministic  data  association  criterion  used  to  select  the  “best”  hypothesis,  which  is 
then  used  to  generate  the  MAP  estimate  of  the  system  state.  The  second  defined  in  the  Figure  is 
probabilistic  data  association  (PDA),  which  updates  the  track  state  confidence  for  each  report 
based  upon  its  relative  association  confidence  score.  The  third  criterion  in  the  figure  is  the  joint 
hypothesis  and  state  optimization  (JHSO)  score. 

The  MAP  kinematic  scoring  for  a  new  incoming  sensor  report,  S,  to  an  existing  track,  T, 
assumes  a  Gaussian  distribution  with  a  central  track  covariance  P  that  models  the  error  in  the 
track  location.  For  the  single  report  case  la  and  lb  and  for  the  two-report  case  the  non¬ 
association  hypotheses  are  assumed  to  be  near  zero  probability.  For  case  2  we  test  an  input  report 
that  is  a  pop-up  (i.e.,  not  the  same  object  as  any  of  the  tracks).  For  this  case  the  scene  hypothesis 
scores  are  each  the  product  of  the  individual  hypothesis  scores  for  how  all  the  given  batch  of 
reports  and  tracks  are  associated.  Namely, 
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•  DETERMINISTIC  DATA  ASSOCIATION  THEN  TARGET  - 

MAX  P(H\REPORTS)=  MAX[P(REPOR  TS\H  )P  (  H  )  T II  E  N  M  A  X  P{0  \ll  ) 

I,  H  0 

•  TARGET  STATE  ESTIMATION  WITH  PROBABILISTIC  DATA 

MAX  P(Q  \REPORTS)=  P  {  R  E  P  O  R  TS\  H  ,0  )P  (  H \d)Y(  0) 

0  0  H 

•  JOINT  ASSOC  lAT  10  N  DECISION  AND  TARGET  STATE 

MAXP(H,Q  \REP0RTS)=  M  AX[M  ax  P(0\REPORTS,H  )jP(H\REPO  RTS) 
H  ,0  H  0 

Figure  1 ;  A  Comparison  of  MAP,  JHSO,  and  PDA  Hypothesis  Evaluation  Criteria 


1 .  Association  Hypotheses: 

P(H|S,T)  =  P(S1T,H)  P(H)=  {|Vl'''^}exp[-l/2{f  V'l}]  [I-Pfa(S)]  [I-Pfa(T)]  Pd(S)Pd(T) 

2.  Pop-up  and  Track  Propagation  Hypotheses: 

P(H|S,T)  =  P(S1T,H)P(H)  =  {E(lP+Rr''^)}exp[-l/2{.455}][l-PFA(S)][l-PD(T)]PD(S)[l-PFA(T)]  [1- 
Pd(S)]  Pd(T) 

where  for  these  evaluations, 

•  S  is  the  sensor  report  with  variance  R, 

•  T  is  the  track  with  variance  P, 

•  H  is  the  hypothesis  that  the  report  and  track  are  associated, 

•  |V|  is  the  determinant  of  the  innovations  covariance,  V  =  P  +  R, 

•  I  is  the  innovations  vector,  I  =  S  -  T 

•  Pd  (S)  is  the  probability  of  detection  for  this  object  reported  by  the  sensor  =  .5  here. 

•  Pfa  (S)  is  the  probability  of  false  alarm  (FA)  of  the  sensor  for  this  type  of  report  =  .  1 

•  Pd  (T)  is  the  probability  of  detection  of  this  object  in  the  track  file  =  .7 

•  Pfa(T)  is  the  probability  that  this  track  is  a  false  alarm  =  .01 

•  the  E(|P+Rr''^)  for  one  report  (i.e.,  S)  and  two  tracks  (i.e.,  T1  and  T2)  is  the  following 
average 

{lV(S-Tl)r''^+  |V(S-T2)r’'^}/2 

•  False  Alarm  and  Track  Drop  hypotheses  are  assumed  to  have  a  much  lower  confidence  so  are 
not  used  here. 

The  normalized  comparison  of  these  first  three  scores  on  a  N(0,1)  distribution,  given  in 
Figure  2,  shows  the  differences  in  the  scores  as  the  report-to-track  separation  increases.  This 
difference  emphasizes  the  importance  of  selecting  the  correct  kinematics-scoring  scheme  to  be 
rigorously  comparable  with  the  ED  and  a  priori  statistics. 
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Figure  2:  Comparison  of  Alternative  Gaussian-Based  Association  Scoring  Techniques 


1.4  Probabilistic  Data  Association  (PDA)  Score 

The  PDA  score  maximizes  the  probability  of  the  object  state  given  the  reports.  Thus,  the  PDA 
updated  state  estimates  are  as  follows: 

•  For  case  1 :  [P(association)  =  1  ] 

T1  estimate  =  [  Kalman  update  of  Tl]  [MAP  association  score  S  to  1]  +  draw  for  T1  [  1  -  MAP 

association  score  S  to  1  ]  r  ,  » » *  i> 

T2  estimate  =  [Kalman  update  of  T2]  [  MAP  association  score  S  to  2]  +  draw  for  T2  [  1  -  MAP 

association  score  S  to  2] 

•  For  case  2:  [P(false  alarm  &  track)=  0] 

S  estimate  =  [  Kalman  update  of  Tl  with  S]  [MAP  score  S  to  1]  +  [Kalman  update  of  T2  with 
S]  [  MAP  score  S  to  2]  +  draw  for  S  [  MAP  score  that  S  not  associated] 

Tl  estimate  =  [Kalman  update  of  Tl  with  S]  [MAP  score  S  to  1]  +  draw  for  Tl  [  1  -  MAP 
scores  to  1] 

T2  estimate  =  [Kalman  update  of  T2  with  S]  [  MAP  score  S  to  2]  +  draw  for  T2  [  1  -  MAP 
score  S  to  2] 

•  For  case  3:  [P(association  =  1)] 

Tl  estimate  =  [Kalman  update  SI  to  Tl]  [  MAP  score  of  SI  to  Tl]  +  [Kalman  update  S2  to  Tl] 

[MAP  score  of  S2  to  Tl]  , 

T2  estimate  =  [Kalman  update  SI  to  T2]  [  MAP  score  of  SI  to  T2]  +  [Kalman  update  S2  to  T2] 

[MAP  score  of  S2  to  T2] 

1.5  Joint  Association  and  State  Optimization  (JHSO)  Score 


Instead  of  maximizing  over  all  the  hypotheses,  as  in  the  MAP,  or  over  all  state  estimates,  as  in 
the  PDA,  this  score  maximizes  over  both  simultaneously.  Namely,  the  JHSO  association 
hypothesis  kinematic  scoring  for  a  new  incoming  sensor  report,  S,  to  an  existing  track,  T,  each 
with  a  Gaussian  distribution  having  a  report  and  track  covariance  of  R  and  P(k-l),  respectively  is 
computed  for  association  hypotheses  as  follows: 

P(  eiS,T,H)  P(H|S,T)  =  {|P(k)r'^^}  {|Vr’^^}  exp[-l/2{f  V'  I }]  [1-Pfa(S)][1-Pfa(T)]Pd(S)Pd(T) 
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where  .  -  _ 

•  0  is  the  MAP  estimate  of  the  track  kinematics  state  updated  with  the  associated  report,  0  - 

T(k) 

.  T(k)  =  T(k-l)  +  K[S(k)-T(k-l)] 

•  |P(k)l  is  the  determinant  of  the  updated  track  kinematics  state  covariance, 

P(k)  =  [l-K]P(k-l) 

•  K  is  the  track  state  update  Kalman  gain, 

K=  P(k-l)[P(k-l)  +  R]'' 

2.0  Performance  Evaluation  Criteria 

The  performance  evaluation  criteria  are  the  percentage  of  mis-associations  for  the  four 
that  make  such  a  decision  (i.e.,  all  but  PDA).  For  all  approaches  the  mean  and  variance  of  the 
error  in  the  Kalman  estimate  is  computed.  The  combined  average  performance  metric  used  is  the 
root  sum  squared  (RSS)  of  the  means  in  the  errors  divided  by  the  standard  deviations  m  Kalman 
estimate  given  the  correct  association  for  each  object.  Namely, 

Avg.  Perf.  =  {  (mean  error  (j)^  /  P(l)O)) 

where  the  sum  is  over  the  true  objects,  j,  and  P(l)  =  (I  -  K)  P(0)  is  the  updated  covariance  of  the 
object  states  where  K  is  the  optimal  Kalman  gain. 

3.0  Performance  Evaluation  Results 

The  performance  results  show  that  no  single  association  approach  is  the  “golden  score”. 
For  cases  where  all  the  covariances  are  equal,  all  the  association  decisions  are  the  sarne.  Thus 
we  focus  on  differing  covariance  cases  and  to  keep  the  representations  simple  a  single  kinernatics 
dimension  is  used  following  all  the  basic  Kalman  filter  assumptions.  Case  1  tests  the  association 
of  a  single  report,  S,  with  one  of  two  tracks,  T1  and  T2.  S  is  simulated  to  have  arisen  from  the 
same  object  as  T1  by  performing  a  Gaussian  draw  for  each  at  the  same  mean  (i.e.,  fiS=pTl). 
This  mean  is  varied  from  -25  to  45;  all  draws  for  S  and  T1  have  a  standard  deviation  of  1.  Track 
2  is  drawn  from  a  Gaussian  with  mean  and  standard  deviation  of  10.  Each  trial  at  a  given  set  of 
means  is  run  thru  1500  draws  to  compute  the  average  mis-association,  mean  error,  and  standard 
deviation  of  the  mean  error  for  each  object. 

The  percentage  of  mis-associations  for  each  of  the  first  four  association  selection 
approaches  (i.e.,  deterministic  association  scoring  schemes)  is  shown  in  Figure  3.  CHI  and  CHI- 
Tail  have  the  same  association  decisions  even  though  the  shape  of  their  scores  with  report-to- 
track  differences  varies.  This  is  due  to  the  fact  that  with  only  one  report  and  2  tracks  the  point  at 
which  the  CHI  scores  are  equal  is  the  same  point  in  all  cases  as  where  the  CHI-Tail  scores  are 
equal  (i.e.,  one  is  a  function  of  the  other).  This  is  not  the  case  in  general.  For  this  case  1,  JHSO 
performs  slightly  better  than  MAP  and  both  significantly  better  than  the  CHI  scores.  This 
improved  association  performance  also  yields  better  tracking  performance  as  shown  in  Figure  4. 
In  fact  both  JHSO  and  MAP  have  better  tracking  performance  than  PDA  even  though  PDA  bases 
its  association  confidence  update  weight  on  MAP.  For  comparison  the  results  for  the  same  set  of 
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trials  but  with  the  standard  deviation  of  the  draw  for  T2  equal  4,  showed  an  even  larger 
pcrfonnance  improvement  of  MAP  and  JHSO.  For  another  companson  where  the  accuracy  o 
the  associated  iLk  is  larger  than  that  for  the  non-assoemted  ^ 

report  equal  to  the  nrean  of  track  T2  (i.e„  pS=pT2)  and  set  pTl-2.  ^1“  RSS  tracking  erm 
performance  is  plotted  in  Figure  5.  In  this  case  the  CHI  scores  perfo™  bet  e  tta  both 
Ld  JHSO  both  for  association  and  tracking  performance,  since  the  CHI  scores  favor  the  larger 

covariance  track.  As  before,  PDA  falls  in  between. 

One  of  the  major  benefits  of  the  MAP  and  JHSO  scores  is  that  they  are  rigorously 
compatible  with  scores  incorporating  other  information  (e.g.,  probability  of  detection  and  a 
alarm  ID  attributes,  etc.).  To  provide  a  simple  companson  of  this  performance  we  inse 

:!;™’on  an  object  that  is  not  Iher  that  for  Tl  or  T2.  V^Tud  0  whh 

deviation  of  1,  at  various  means  from  -12  to  22  and  leave  pTl-2  with  oTl-1  and  pT2  10  with 
oT2=10.  This  case  2  tests  the  ability  of  the  5  approaches  to  distinguish  a  new  pop-up  object. 
The  mis-association  and  RSS  tracking  error  results  are  shown  in  Figures  6  and  7,  respecti  y. 
The  CHI  scores  show  different  association  decisions  since  there  is  now  three  ^ 

The  CHI  Tail  nerforms  slightly  better  than  CHI  and  both  are  significantly  worse  than  JHSO  and 
mIp  MAP  hLfrsmlsfRSS  .racking  error,  however  JHSO  has  .he  snralles.  average 
s.andard  deviation  in  .he  .racking  error  for  all  mean  Inals  and  all  objec.s,  R"  ““P'l’j 
average  standard  deviation  in  the  error  for  the  new  object  (3)  is  shown  m  P®  ‘ 

for  objec.  2  il  is  8  vs  >10  for  all  Ihe  olhere  and  for  objeci  1  .1  is  .4  vs  I  for  all  the  others. 

The  performance  for  a  case  3  with  Iwo  reports  and  two  tracks  and  no  allowed  P°P-“PS  of 
propagated  tracks  was  run  next.  The  results  for  1500  draws  with  the  means  of  report  and  <r^R  ' 
I  2  with  sigma  of  1  and  means  of  report  and  track  2  a.  10  sj^a  of  ^  showedjdnj 
performing  best  with  3%  mis-associations  and  an  RSS  accuracy  of  .03.  JHSO  and  CHI  came  in 
second  wifh  33%  and  .15.  CHI-tail  in  .hW  with  40%  and_25. 

RSS  accuracy  of  1.4.  For  these  single  dimensional  case  3  results  the  JHSO  the 

results  as  the^CHI  since  the  JHSO  state  terms  cancel  to  within  a  constant  with  the  MAP  terms. 

This  in  general  is  not  the  case. 

In  summary,  this  research  task  has  derived  a  new  association 
and  compared  its  performance  with  four  traditional  association  approaches.  ^^SO  ^elds  the 
best  association  and  estimation  results  for  problems  where  an  accurate  ^eport  ^nd  tr^  e.|, 
from  on-board  sensors)  are  being  considered  for  association  vs  another  less  accurate  track  (e.g 
from  off-board).  The  other  approaches  are  biased  towards  the  less  accurate  trac  since  y 
not  consider  the  resultant  state  accuracy  in  their  scoring  for  the  alternative  associations. 
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Figure  6 
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Figure  8 
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II.  Learning  in  Distributed  Fusion  Systems  for  Decision-Making 
Principal  Investigators:  Dr.  Galina  Rogova,  Adjunct  Professor,  UB;  Raghu  Menon,  Graduate  Student 


The  research  of  this  task  addresses  issues  of  cooperative  group  learning  from  examples  m 
a  multi-agent  distributed  system  for  decision-making.  An  approach  to  both  individual  learning 
with  decision  integration  and  distributed  learning  utilizing  the  Dempster-Shafer  theory  of 
evidence  is  introduced.  The  implementation  of  this  approach  in  different  machine  learning 
paradigms  corresponding  to  different  types  of  agents  interaction  with  their  environment  is  also 
presented.  The  case  study  considered  in  the  research  has  demonstrated  significant  improvements 
not  only  in  overall  performance  of  the  system,  but  in  the  case  of  distributed  learning,  and  also  in 
recognition  accuracy  of  individual  agents.  The  developed  method  is  especially  important  in  real- 
life  applications  when  construction  of  a  large  training  data  set  is  very  expensive  or  impractical. 
The  introduced  adaptive  fusion  method  for  learning  in  distributed  systems  is  not  problem 
specific  and  can  successfully  be  used  for  both  military  and  non-military  applications  for  target 
recognition,  situation  assessment,  image  retrieval,  pattern  recognition,  medical  imaging,  etc. 

The  objective  of  this  research  is  to  develop  an  approach  to  improved  decision  making 
ability  of  a  multi-agent  distributed  system  as  the  result  of  learning.  The  interest  in  the  distributed 
problem-solving  system  stems  from  the  fact  that  many  real-world  problems  can  be  better  solved 
using  a  set  of  cooperative  agents  rather  than  a  single  agent  [1].  A  general  multi-agent  system 
consists  of  a  group  of  distributed  intelligent  agents  that  coordinate  their  knowledge,  goals,  skills 
and  plans  so  that  they  can  make  decisions,  take  actions  and  solve  problems  (see,  e.g.,  [1-4]). 
Interaction  between  agents  may  occur  at  a  number  of  levels:  at  the  knowledge  level,  at  the 
planning  level,  or  at  the  action  level  (knowledge,  possibility,  and  choice)  [5].  Agents  in 
distributed  systems  may  have  different  areas  of  expertise,  a  priori  know-ledge,  and  problem¬ 
solving  abilities.  They  may  be  able  to  observe  only  certain  characteristics  of  the  environment,  or 
they  may  observe  different  parts  of  the  environment  (spatially  or  temporally),  or  some  of  them 
may  be  able  and  some  of  them  may  not  be  able  to  interact  with  environment.  Since  no  one  agent 
has  complete  information  about  environment,  they  have  to  cooperate  to  achieve  their  goals.  In 
the  research  addressed  on  this  task,  efforts  were  concentrated  on  the  knowledge  level  interaction 
between  agents  and  address  the  problem  of  learning  in  a  distributed  system  that  is  designed  to 
make  decisions  about  the  states  of  environment.  The  learning  goal  here  is  to  adjust  the  system  s 
decision-making  process  in  order  to  improve  its  performance  in  future  situations.  In  distributed 
systems,  this  goal  can  be  achieved  as  a  result  of  interaction  between  the  system  and  environment 
and  cooperation  between  the  agents  that  may  exchange  their  a  priori  knowledge,  observations 
and  local  decisions. 

1.0  The  Model 

This  section  addresses  the  issues  of  group  learning  in  a  multi-agent  distributed  system 
when  agents  learn  individually  and  do  not  communicate  during  the  learning  process  with  each 
other.  We  consider  here  a  two-layer  distributed  system  where  the  lower  level  agents  have 
different  expertise  and  either  can  observe  independent  features  of  the  environment,  or  use 
different  processes  to  make  local  decisions  about  the  states  of  environment.  We  assume  here  that 
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the  set  of  hypotheses  about  environment  is  given  to  each  agent  «  prion.  This  situation  may 
Ltear  len  we  have,  for  example,  agenis  represented  by  different  types  of  sensors,  or  agents 
cxLctins  different  features  of  environment.  The  lower  level  agents  m  our  system  are  modeled 
Ty  ^e  anV"  ral  networks  that  are  very  effeetive  when  used  for  “ 

recognition  They  are  designed  to  learn  from  examples  and  are  very  robust  when  deal  with 
uncertain  and  incomplete  input  information  (both  numenc  and  symbolic).  We  will  consider  t 
different  types  of  interaction  between  the  lower  level  agents  and  environment  , 

various  le^ing  paradigms.  In  supervised  learning,  the  environment  can  act  as  a  knowledgeable 
Tche  the  desired  decision  as  a  feedback  which  then  is  used  to  modify 

Te  deaW  ^  of  ^he  classifier.  In  reinforcement  leaning,  the  environmen 

evaluates  the  decision  and  provides  only  binary  reinforcement  ^ Je 

decision  In  unsupervised  learning,  the  system  does  not  obtain  any  feedback  and  ohays 
decision  function  based  on  internal  structure  of  the  training  set.  At  the  problem-solving  s  age, 
each  agent  uses  its  expertise  to  acquire  infomation  about  the  state  of  environment,  makes  local 
decisions  about  global hypotheses  and  transmits  the  decisions  with  their  '"f  " 

fusion  cemer  where  the  agents  decisions  are  combined  in  order  to  produce  the  final  decision.  The 
fusion  center  does  not  interact  with  environment  and  employs  only  the  ^ 

each  individual  agent.  The  fusion  process  combines  decisions  made  by  he  “8="^  f 
advantage  of  the  correct  decisions  produced  by  each  agent  ^d  dealing  with  conflict  g 
decisions.  The  architecture  of  the  system  considered  in  our  research  is  presented 
Figure  9. 


The  described  process  of  individual  learning  by  agents  with  , 

integration  in  the  fusion  center  has  several  advantages  as  compared  to  the  process  of  distributed 
infomation  gathering  and  individual  learning  when  the  agents  make  observations,  t^nsmit  the 
observations^to  the  fusion  center  for  the  learning  based  on  composite  observations.  One  of  he 
SrantSes  is  that  transmission  of  the  confidence  levels  reduces  the  amount  of  information 
transmitted  as  compared  to  transmission  of  observations.  Another  advantage  of  employing 
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decision  fusion  process  is  that  it  improves  the  overall  problem  solving  quality  of  the  system  as 
compared  with  problem  solving  quality  of  an  even  the  best  individual  agent.  This  process  can 
also  achieve  better  recognition  accuracy  with  less  number  of  training  patterns  that  is  especially 
useful  when  the  number  of  training  patterns  is  insufficient  and  the  process  of  obtaining  additional 
training  patterns  is  costly  or  impractical  or  training  time  is  limited.  Several  techniques  have  been 
used  for  decision  fusion;  majority  voting  [11,12],  Bayesian  decision  theory  [11],  Neural 
Networks  [13],  the  Dempster-Shafer  theory  of  evidence  [1 1,14,15].  The  latter  seems  to  be  best 
suited  for  decision  combination  because  it  does  not  require  many  training  patterns,  and  provides 
conflict  resolution  capability  and  means  to  include  subjective  judgment.  It  also  allows  us  to 
represent  ignorance  and  uncertainty. 

The  idea  behind  the  process  introduced  in  this  report  is  borrowed  from  the  well-known 
and  widely  used  in  pattern  recognition  "minimum  distance  classifier".  In  this  classifier,  a 
classification  decision  is  based  on  the  minimum  distance  in  the  feature  space  from  a  pattern  in 
question  to  a  class  reference  vector.  In  our  evidential  fusion  system,  a  classification  decision  is 
based  on  the  belief  in  any  classification  hypothesis  that  represents  a  combination  of  individual 
beliefs  estimated  for  the  neural  networks  modeling  the  agents.  Individual  beliefs  are  computed 
within  the  framework  of  the  Dempster-Shafer  theory  of  evidence  as  a  function  of  a  distance 
between  pattern  representation  and  output  characteristics  of  the  neural  networks  (output  vectors 
or  weight  vectors  depending  on  the  type  of  learning).  Belief  combination  is  earned  out  with  the 
Dempster  rule  of  combination.  Therefore,  we  can  consider  our  evidential  classifier  as  a 
combination  of  evidential  distance  classifiers  (EDC)  built  upon  NNs  considered  in  the 
combination. 


2.0  Results 

The  goal  of  the  experiments  described  in  this  subsection  is  to  show  that  the  performance 
of  the  introduced  evidential  classifier  that  integrates  decision  of  agents  trained  individually  is 
better  than: 

1 .  Performance  of  the  best  individual  agent. 

2.  Performance  of  the  system  where  the  fusion  center  modeled  as  a  neural  network  is 
trained  on  combined  observations  transmitted  by  the  lower  level  agents. 

We  have  conducted  three  types  of  experiments  corresponding  to  different  kinds  of  inter¬ 
action  with  environment  by  lower  level  agents:  feedback  as  a  reference  signal  (supervised 
learning),  feedback  as  a  reinforcement  signal  (reinforcement  learning),  and  no  feedback  at  all 
(unsuperiised  learning).  The  agents  modeled  as  supervised,  unsupervised,  and  reinforcenient 
neural  networks,  respectively,  are  trained  individually  and  then  their  decisions  are  combine  in 
the  fusion  center.  We  also  trained  the  fusion  center  modeled  by  a  neural  network  with  a  long 
feature  vectors  constructed  as  a  concatenation  of  the  available  feature  vectors  as  input.  The  latter 
corresponds  to  the  type  or  learning  where  the  agents  make  observations  and  transfer  them  to  the 
fusion  center  which  is  then  trained  on  a  feature  vector  containing  all  the  observations  (individual 
learning  with  distributed  information  gathering). 
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The  results  of  learning  on  combined  observations  turned  out  not  better  than  the  ''“ults  of 
the  best  individual  agent.  This  phenomenon  can  be  explained  by  the  fact  that  we  0°  ^^e  ^e 

number  of  training  patterns  in  our  database  that  are  sulTicient  for  Irammg  with  a  h^to 
dimensional  input  vector.  We  may  hope  that  this  result  can  be  improved  by  adding  new  patterns 
for  training  the  neural  network,  although  adding  new  patterns  to  the  training  set  may  be  very 
difncult,  costly,  and  even  impractical  in  many  real-life  situations.  Utilization  of  the  <i“'s'oo 
fusion  method  introduced  in  this  research  gives  us  a  significant  improvement  inaccuracy  without 
incorporation  of  additional  training  patterns.  The  data  shows  the  supenor  performance  of  group 
learning  in  distributed  system  with  the  developed  decision  fusion  method  as  compared  with 
performance  of  the  individual  learning  in  distributed  system  based  on  combtned  observations  and 
performance  of  the  best  individual  agent. 

The  results  of  additional  experiments  showed  that  the  research  on  the  distributed 
reinforcement  learning  method  designed  on  the  project  yield  ^'gn'ficant  improvement  in  he 
system  performance.  Overall  system  performance  improves  on  average  by  68 /o  as  compared 
Jith  sii^le  decision  fusion  with  knowledge  integration  in  the  case  when  the  lower  level  agents 
do  not  have  access  to  environment.  The  distributed  reinforcement  learning  technique  my  aly 
improve  the  performance  of  the  individual  agents  trained  as  reinforcement  neural  networks 
individually.  For  the  “texture”  and  “color  histogram”  agents  of  these  experiments  cooperative 
learning  improves  performance  by  an  average  accuracy  over  individual  agents  by  50 /o. 


3.0  Conclusions 

The  research  described  in  this  report  has  addressed  issues  of  cooperative  group  learning 
from  examples  in  multi-agent  distributed  system  for  decision-making.  ^  aPPyach  to  both 
individual  learning  with  decision  integration  and  distnbuted  learning  utilizing  the  Dernpster- 
Shafer  theory  of  evidence  has  been  introduced.  The  implementation  of  this  approach  in  different 
machine  leLing  paradigms  corresponding  to  different  types  of  agent  interaction  with 
environment  has  Lo  b!en  presented.  The  case  study  considered  m  the  resey^  h^ 
demonstrated  significant  improvements  not  only  in  overall 

case  of  distributed  learning,  also  in  recognition  accuracy  of  individual  agents.  The  deve  p 
adaptive  fusion  method  for  learning  in  distributed  systems  is  not  problem  specific  and  can 
successfully  be  used  for  both  military  and  non-military  applications  for  target  reygnition, 
situation  assessment,  image  retrieval,  pattern  recognition,  medical  imaging  etc  ^he  develyed 
method  is  especially  important  in  real-life  applications  when  constructiori  of  a  large  training  set 
is  very  expensive  or  impractical.  However,  more  research  is  needed  in  order  to  address 
fundamental  issues  of  the  problem  of  cooperative  learning  m  problem  solving  systerns  such  a 
utilization  of  a  priori  knowledge,  incorporation  of  symbolic  and  numenc  information, 
convergence  of  the  process,  etc.  A  very  important  problem  to  be  addressed  m  *e  future  is  the 
definition  of  measures  of  effectiveness  and  designing  optimal  learning  strategies  and  method  for 
knowledge  representation  and  exchange. 
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III.  Information-Sharing  in  Distributed  Fusion  Applications 

Principal  Investigators:  Dr.  Henry  Hexmoor,  Adjunct  Professor,  UB;  Dr.  James  Llinas,  Research 
Professor,  UB;  Elizabeth  Cuddihy,  Graduate  Student 


When  situation  assessment  is  performed  individually  by  cooperative,  friendly  agents 
working  toward  a  commonly  held  goal,  optimal  strategies  for  sharing  informahon  are  needed. 
The  best  strategies  are  often  domain  dependant  with  respect  to  constraints  imposed  by  the 
domain  itself.  Appropriate  strategies  for  information  sharing  can  be  selected  by  looking  at  the 
overall  performance  of  a  strategy  based  on  a  set  of  predefined  metrics  measuring  qualities  such 
as  information  consistency  across  the  agents,  information  completeness  among  the  agents,  and 
timeliness  of  information  availability  to  each  agent.  This  task  conducted  research  focused  on 
exploring  the  development  of  specific  strategies  for  information-sharing  among  distributed 
fusion  nodes,  using  a  case-study  approach.  We  have  developed  a  prototype  system,  SAM-ISS, 
within  a  Theater  Missile  Defense  scenario  that  we  have  used  to  investigate  the  utility  of  a  set  of 
metrics  for  determining  the  quality  of  three  different  information  sharing  strategies  (ISS). 


1.0  Introduction 

The  process  of  situation  assessment  is  a  common  human  activity.  Within  the  cycle  of 
perceiving  one's  surroundings,  cognitively  processing  the  input  with  other  relevant  information, 
followed  by  producing  an  appropriate  action,  situation  assessment  involves  the  processes  of 
perception  followed  by  understanding.  These  are  difficult  cognitive  processes  to  model 
computationally  yet  these  are  essential  components  of  an  autonomous  agent,  be  it  human,  an 
animal,  or  artificial. 

Smith  and  Sage  [9]  define  situation  assessment  as  "the  process  of  detecting  and  defining 
an  opportunity  or  problem."  Although  this  definition  alludes  to  the  necessity  of  cognitive 
processing  to  realize  the  situation,  the  definition  does  not  take  into  account  the  act  of  performing 
data  aggregation  and  fusion  over  input  from  an  array  of  different  modalities.  For  this  reason,  we 
will  define  situation  assessment  as  the  mental  process  of  aggregating  sensory,  non-sensory, 
and  a  priori  input  to  construct  a  mental  representation  of  a  situation.  A  situation  is  any 
meaningful  abstraction  of  personal,  group,  and  environmental  information  relevant  to  the  agent's 
set  of  goals. 

We  call  this  model  Cooperative  Individual  Situation  Assessment  (CISA)  between  a  group 
of  agents.  We  define  CISA  as  the  exchange  of  information  between  fnendly  agents  in  order  for 
each  agent  to  individually  perform  unique  situation  assessment  within  its  own  “mind.”  This 
differs  from  other  information  sharing  scenarios  that  could  arise  in  a  multiple  agent  setting  by 
placing  a  certain  constraints  on  the  types  of  interactions  agents  can  expect  when  sharing 
information.  First,  all  agents  can  assume  that  the  information  received  from  other  agents  is 
qualified  with  respect  to  the  task  at  hand  rather  than  consisting  of  raw  data.  Secondly,  all  agents 
can  assume  fnendly,  rather  than  adversarial,  interactions  with  other  agents.  By  friendly 
interactions,  all  agents  can  assume  that  their  communications  with  each  other  will  follow  the 
Cooperative  Principle  described  by  Grice  [5]  in  the  following  set  of  supermaxims:  (1)  the 
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quantity  of  information  provided  is  neither  more  or  less  informative  than  needed;  (2)  the  q^lity 
of  infonnation  does  not  include  anything  that  the  sending  agent  believes  to  be  false  or  lacks 
adequate  evidence;  (3)  the  information  exchanged  is  relevant;  and  (4)  the  manner  in  whic 
information  is  given  avoids  obscurity,  ambiguity,  and  is  bnef  and  orderly. 

This  model  makes  no  assumption  of  all  the  agents  seeking  a  collective  goal  although  it 
does  allow  for  agents  to  do  so  if  each  agent  individually  holds  the  goal  and  decides  to  wor 
toward  it.  For  related  material  see  [1,2, 3,4, 6, 7, 8]. 

2.0  The  SAM-ISS  Testbed 

We  have  developed  a  prototype  to  simulate  Surface  to  Air  Missile  (SAM)  units 
comprised  of  three  specialized  vehicles.  Within  our  testbed  the  SAM-ISS  ^ 

implemented  three  modules:  a  domain  simulator,  a  ISS  performance  analyzer,  and  a  grap 

user  interface  (GUI). 

The  testbed  is  currently  modeled  around  an  information  sharing  problem  within  the 
domain  of  Theater  Missile  Defense.  This  problem  consists  of  three  stationa^  sensing  "o^^s  on  a 
battlefield  that  are  each  on  the  look  out  for  Surface  to  Air  Missile  units  (SAMs)  compn^ 
three  specific  ground  vehicles:  a  power  vehicle,  a  communications  vehicle,  and  a  transporter 

vehicle. 

Each  sensing  node  is  able  to  see  only  a  portion  of  the  battlefield,  in  a  conical  cross- 
section  with  the  apex  at  the  node,  extending  outward  across  the  field,  away  from  the  node.  This 
is  marked  on  the  battlefield  as  three  triangles  of  visibility  extending  out  from  each  of  the  tlue 
nodes  Due  to  the  spacing  of  the  nodes,  some  areas  of  the  battlefield  are  out  of  view  of  all  nodes 
some  areas  are  covered  by  one  node,  and  other  areas  have  redundant  coverage.  Band-shaped 
regions  on  the  battlefield  corresponding  to  the  amount  of  node  visibility  coverage  ^^ve  bee 
m^ed  as  low,  medium,  and  high  visibility.  The  high  visibility  region  has  complete  ^d 
redundant  coverage  throughout  the  region,  with  over  half  of  the  region  covered  by  2  nodes.  The 
medium  visibility  region  has  incomplete  coverage  with  small  pockets  of  redundant  coverage^ 
small  pockets  of  no  coverage.  The  low  visibility  region  has  large  areas  totally  just  over  half  of 
the  region,  with  no  visibility  coverage;  the  other  areas  in  the  low  visibility  region  have  coverage 

only  by  a  single  node  (see  Figure  1). 
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Figure  1:  Battlefield  display  showing  nodes  at  the  bottom  of  the  field  and  the  ^nge  of 
the  node’f  sensors  extending  up  from  each  node.  Three  visibility 

marked  on  the  battlefield  based  on  the  percentage  of  node  sensor  coverage  within  that  . 
These  horizontal  coverage  regions  have  been  marked  as  high,  medium,  and  low  visibility.  Two 

Cl,  Tl,  PI,  and  C2,  T2,  P2  are  also  shown.  These  represent  the 

vehicles  within  two  separate  SAM  units. 


The  six  vehicles  move  through  the  field  in  accordance  to  one  of  several  predefined 
scenarios  In  each  scenario,  the  vehicles  travel  in  two  groups  of  three,  where  each  group  s 
comprised  of  a  transporter-erector-launcher  vehicle  (marked  T),  a  coinmunications  vehicle 
(marLd  C)  and  a  povJ^r  vehicle  (marked  P).  Such  a  grouping  is  called  a  SAM,  a  surface  to  air 
missile  unit.  These  two  SAMs  can  be  positioned  anywhere  in  the  field  prior  to  ^"^mg  a 
simulated  scenario.  As  the  vehicles  move  through  the  field  dunng  a  scenario,  the  nodes  detect 
the  vehicles  that  exist  within  their  field  of  view.  If  a  node  detects  tluee  vehicles 
formation  such  that  the  unit  is  comprised  of  a  T,  C,  and  P  vehicle,  the  node  will  surmise  that 

viewing  a  SAM  unit. 

A  SAM  unit  can  be  in  one  of  three  modes  while  the  simulation  is  tumtaS-  modes 

are  moving  arming,  and  launching.  When  a  SAM  is  arming  or  launching  that  SAM  is  ^o 
have  had  an  event.  Nodes  that  have  detected  a  SAM  are  able  to  detect  SAM  events.  Within  te 
model  we  assume  1 00%  sensor  accuracy.  If  a  vehicle  is  m  a  visibility  region  for  a  "ode,  it  will 
always  be  seen.  Likewise,  if  the  three  vehicles  comprising  a  SAM  detected  together  by  one 
node  within  its  visibility  region,  then  the  node  realized  that  it  has  spotted  a  SAM. 


3.0  Test  Scenarios 

Three  scenarios  for  vehicle  movement  have  been  defined  within  this  testbed,  two  of 
which  have  been  used  for  the  initial  ISS  analysis  described  within  this  paper.  The  first  scenan 
is  one  in  which  one  of  the  SAM  units  travels  horizontally  from  left  to  nght 
while  the  other  unit  travels  horizontally  from  right  to  left.  For  this  scenano,  the  SAM  u^ts  wn 
be  placed  within  the  low,  medium,  or  high  visibility  bands,  or  in  any  combination  of  two  bands_ 
WiSiin  this  scenario,  a  SAM  unit  stays  within  a  single  visibility  band  ,, 

Ae  Lnario.  The  second  scenario  places  one  SAM  unit  such  that  it  travels  vertically  through  all 
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.hrcc  visibility  bands,  from  low  .o  high  while  .he  other  SAM  uni.  travels  horizontally  across  the 
battlefield  within  one  of  any  of  the  three  visibility  bands. 

These  two  scenarios  allow  for  ISS  tests  in  circumstances  where  this  is  little  information 
to  be  shlred  u^Through  scenarios  where  information  could  potentially  be  shared  eonttnuously. 


In  our  implemented  system  we 


used  the  following  specification  as  a  specialized  production  rule: 


IF  <  sender- filter> 

THEN  <sender>  GENERATE  . 

FOR  <  recipient>  THAT  MEET  <fiIter-potential-recipient> 

SEND  <filter-recipient> 

The  <sender-filter>  is  the  set  of  conditions  under  which  the  message  source  will  send  a 

information.  <message>  is  the  composition  format  ’  ^otential-recipient>  are  the 

encoded  ISS  teleologies. 

Three  information-sharing  strategies  have  been  defined  among  the 

STisgSHHsiMS'i; 

identification  of  each  vehklejt  is^Ie  b^  Sn^launchinT  This 
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launching  event  is  observed,  this  information  is  shared.  Event-based  differs  by  only  sharing 
information  when  SAMs  are  observed  having  an  arming  and  launching  event,  limiting  the 
communications  only  to  times  when  information  of  highest  importance  needs  to  be 
communicated. 

Due  to  limited  space  we  will  omit  details  of  simulator  implementation.  Our  current 
implementation  only  includes  a  basic  set  of  five  ISS  metrics  that  are  gathered  throughout  the 
course  of  one  running  scenario  and  then  displayed  to  the  user.  These  metrics  are: 

Timeliness  -  the  amount  of  time  before  a  node  becomes  aware  of  a  certain  piece  of 
information; 

Consistency  -  the  number  of  nodes  aware  of  a  certain  piece  of  information; 

Completeness  -  the  number  of  pieces  of  information  that  a  node  is  aware  of  as  a  function  of 
time; 

Cumulative  consistency  -  the  percentage  of  nodes  aware  of  individual  pieces  of  information 
as  a  function  of  time; 

Cumulative  completeness  -  the  average  number  of  piece  of  information  each  node  was  aware 
of  over  time. 

4.0  Results  and  Discussion 

Data  was  collected  for  the  first  and  second  scenario  using  broadcast,  event,  and  unique 
ISS  such  that  all  combinations  of  SAM  travel  within  regions  of  visibility  coverage  where  tested. 
The  data  collected  was  based  on  the  five  metrics  discussed  in  the  previous  section:  information 
timeliness,  completeness,  consistency,  plus  cumulative  completeness  and  consistency.  We  omit 
details  of  experiments  and  scenarios  due  to  space  and  only  discuss  results.  Broadcast  ISS,  due  to 
its  policies  of  always  sharing  information  with  everyone,  is  able  to  maintain  completeness  and 
consistency  of  information  across  all  nodes  with  the  most  information  timeliness  possible  but  at 
the  cost  of  extremely  high  communications  traffic.  In  fact,  many  of  the  messages  sent  using 
broadcast  ISS  are  redundant  as  a  node  will  send  out  information  during  every  clock  cycle  that  it 
detects  anything  with  its  sensors.  Thus,  if  a  node  sees  a  communications  vehicle  during  the  first, 
second,  and  third  cycles,  it  will  send  out  messages  to  the  other  nodes  on  all  three  cycles  saying 
that  it  saw  a  communications  vehicle,  despite  the  redundancy.  In  our  current  model,  the  agents 
do  not  possess  any  memory  so  this  redundancy  is  necessary  but  in  a  scenario  with  more  complex 
agents  that  have  the  ability  to  remember  information,  this  ISS  method  would  tend  to  provide  an 
overwhelming  amount  of  redundant  information.  This  method  also  puts  a  greater  strain  on  the 
communications  network.  The  amount  of  information  communicated  throughout  the  course  of  a 
scenario  is  a  function  of: 

(cycles)  *  (no.  nodes)  *  (no.  nodes  - 1)  *  (info  packet  size)  /  (%  of  visibility) 
which  is  clearly  dominated  by  the  number  of  nodes  participating  in  the  scenario,  giving  a 
communications  growth  of  where  N  equals  the  number  of  nodes. 

Event-based  ISS,  which  dictates  that  information  is  only  shared  when  an  event  is 
observed,  shows  the  performance  of  an  ISS  that  is  limited  only  to  sharing  information  when 
something  of  critical  importance  occurs.  This  limits  the  amount  of  communications  traffic 
considerably  but  at  a  cost  to  information  timeliness,  completeness,  and  consistency.  If  critical 
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events  arc  difficult  to  detect  because  the  are  occurring  in  an  area  with  very  low  visibility 
coverage  the  level  of  information  completeness  and  consistency  drops  considerably.  In  the  case 
of  events  occuiring  at  every  time  cycle,  event-based  ISS  will  behave  exactly  as  broadcast  SS^ 
Yet  the  assumption  of  event-based  ISS  is  that  critical  events  are  occurrmg  only  over  a  faction 
of  the  total  time.  Information  completeness  and  consistency  will  depend  on  the  percentage  o 
time  that  critical  events  occur  and  can  be  observed. 

Unique  ISS  manages  to  reduce  the  amount  of  communications  traffic  ^8^"^ 

from  broadcast  ISS  while  providing  higher  information  timeliness,  completeness  and 
Consistency “  found  with  evSnt-based  ISS.  The  amount  of  information  commumcated  over 
Ihe  course  of  a  scenario  is  reduced  only  by  sending  to  a  maximum  of  two  ne.ghbonng  nodes. 
This  reduces  the  communications  growth  to  a  linear  function  of  the  number  of  nodes_ 
LfomJ^on  completeness  and  consistency  will  fair  as  well  over  large  numbers  of  nodes  but 
he  domain  constraints  can  be  satisfied  by  allowing  neighborhoods  of  nodes  to  maintain  local 
lomXls  and  consistency,  than  this  ISS  methods  performs  better  than  the  other  two  with 
respect  to  maintaining  lower  communications  network  traffic. 

Of  the  set  of  metrics  used  in  analysis,  cumulative  completeness,  measuring  the  number  of 
obiects  that  each  node  was  aware  of  over  time,  cumulative  consistency,  and  ineasunng  the 
pSa«  of  toe  each  node  was  aware  of  each  SAM  unit  served  to  be  accurate  indicator  of  an 
ISSs  ability  to  distribute  information  across  all  of  the  nodes.  Additional  metres  for  collecting  th 
amount  ofoverall  network  traffic  would  be  helpful  in  determining  the  eost  of  communica  rons^ 
It  is  possible  that  this  could  be  used  in  conjunction  with 

consistency  to  create  a  system  that  was  able  to  choose  an  appropnate  ISS  on  the  fly  based  on 
current  domain  constraints. 

When  vehicles  traveled  in  low  visibility  areas,  timeliness  scores  where  consistently 
Doorer  This  information  can  be  useful  in  meeting  domain  constraints.  In  such  cases,  a  strategy 
Lch  as  event-based  ISS  would  not  perform  well  and  a  system  could  use  such  knowledge  to 
switch  to  another  ISS  that  performs  better  for  completeness  and  consistency  when  vehicles  are 

harder  to  detect. 

5.0  Conclusion 

We  presented  a  model  and  a  testbed  for  situation  assessment.  Many  pmmeters  affecting 
information  sharing  and  strategies  for  information  sharing  were  discussed  m  the  form  oHcnenc 
questions  Clearly  we  are  moving  in  the  direction  of  developing  a  general  framework  that  is 
appSe  to  a  large  class  of  problems.  Our  testbed  is  missing  a  few  key  P—rs  f 
communication  and  deliberation  did  not  cost  time  and  effort,  communication 
ma“  However,  in  the  real  world,  time  and  effort  are  critical  factor.  We  showed  a  tradeoff 
of  15%  detection  rate  for  a  30%  saving  in  communication.  Cost  and  other  factors  such  as  mo 
of  other  agents  need  to  be  included  in  the  testbed  to  make  it  more  usefu  . 

Our  approach  assumes  the  cooperative  principle  and  Gricean  maxims  used  m  both 
teaching  and  analyzing  human  discourse.  However,  in  order  for  our  information  shanng 
slategifs  to  be  moLled  such,  we  must  add  a  great  deal  of  reasoning  and  resource-sensitivity  to 
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our  agents.  For  example,  we  know  what  it  means  to  be  “relevant"  but  can  not  be  m^e led  easily  _ 
Without  attempting  to  solve  the  holy  grail  of  A1  we  plan  to  (a)  develop  a  more  robust  model  of 
cooperative  individual  situation  assessment,  and  (b)  model  simple  forms  of  principles  from 
language  planning  literature  in  linguistics. 
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